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Abstract 

We describe and analyze how reinforced random walks can eventually local- 
ize, i.e. only visit finitely many sites. After introducing vertex and edge self- 
interacting walks on a discrete graph in a general setting, and stating the main 
results and conjectures so far on the topic, we present martingale techniques 
that provide an alternative proof of the a.s. localization of vertex-reinforced ran- 
dom walks (VRRWs) on the integers on finitely many sites and, with positive 
probability, on five consecutive sites, initially proved by Pemantle and Volkov 
(1999,[Tl]). 

Next we introduce the continuous time-lines representation (sometimes called 
Rubin construction) and its martingale counterpart, and explain how it has been 
used to prove localization of some reinforced walks on one attracting edge. Then 
we show how a modified version of this construction enables one to propose a 
new short proof of the a.s. localization of VRRWs on five sites on Z. 



AMS 2000 subject classifications. 60G50, 60J10, 60K35 

Key words and phrases, reinforced walk, martingale, localization 

Running Head: Localization of reinforced random walks 



1 Introduction 

Exploration of an environment, behaviour learning or cooperative interaction are in- 
stances of situations where the evolution depends on the whole history, either as a 
tendency to visit again "places" visited before or as a tendency to avoid them. In 
exploring an unknown city, streets that have been walked before may be considered 
as more attractive (safer, for instance) or repulsive (boring); learning the best choice 
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among strategies giving random payoffs can be achieved by making random choices with 
an increasing preference towards the choices that pay more; and cooperation between 
micro-organisms, for instance, involves miming previously held behaviours. These situ- 
ations naturally lend themselves to a modelization by self-interacting random processes. 
The definition assumes we are given 

• (Q, J 7 , P) probability space, 

• (G; ~) nonoriented locally finite graph, 

• ( a i,j)i,jeG,i~j propensity matrix with positive entries, such that 
Oij > <=^ i ~ j, 

• W : N — > W + weight function. 

The random process, called (X n )„ eN , takes values in the set of vertices of G; we let 
T n = cr(X , . . . , X n ) be the filtration of its past. For all v G G, n G N U {oo}, let 

n 

Z n (v) = Y,K {Xk = v} + l (1) 

k=0 

be the number of visits to v up to time n plus one. 

Then (X n ) ngN is a Vertex Self-Interacting Random Walk (VSIRW) with starting 
point v G G, propensity matrix (a^)^ and weight function W if X = v and, for all 
n G N, if X n = i then 

nx n+1 - j i ? n ) - ^Y^mzMr (2) 

An Edge Self-Interacting Random Walk (ESIRW) is defined similarly, replacing in 
(j2J) the numbers of visits to vertices I ~ % by those to the corresponding nonoriented 
edges {i, I}: 

n 

Z n ({i, I}) := ^2(l {Xk „ 1= i,x k =i} + l{x k _ 1= i,x k =i}) + 1- (3) 

k=l 

We will define the Edge (resp. Vertex) Reinforced Random Walk as an ESIRW 
(resp. VSIRW) with linear W(n) = n + A, A > —1: these processes were introduced 
by Coppersmith and Diaconis in 1986 [3]. 

In general, the asymptotic behaviour of self-interacting random walks greatly de- 
pends on the nature of the interaction. We will focus here on localization phenomena: 
the difficulty in their analysis lies in the fact that, before this localization occurs, the 
walk can concentrate on several disconnected clusters -separated by seldom visited 
sites- so that the relative numbers of visits follow a rather erratic dynamics, which is 
difficult to analyse. 

For the study of strongly edge reinforced walks (i.e. ESIRW with reciprocally 
summable weight function W), this technical difficulty can be partially overcome by 
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a simple argument, which allows to restrict the study to loop graphs (see Section 
[3]). This argument cannot translate to vertex- reinforced random walks, which display 
localization on "richer" subsets, even on Z, as we describe next. 



1.1 Preliminary remarks 

Let us start our study by the following simple preliminary results, which will enable us 
to gain more intuition on the behaviour of these walks: on one hand on the "simple" 
case of VSIRW on three vertices, and on the other hand on an easy but important 
property of ESIRWs. 

We need to define the two following subsets R and R' of the graph, respectively 
called range and asymptotic range of the process (X n ) n ^ : 



R:={v EG s.t. Z^v) ^ 1} 
R' : ={v eG s.t. Z^v) = oo}. 



We let Cstf constant dependent only on ii, . . ., x n . The equalities and 

inclusions of probability events are understood to hold almost surely. 

1.1.1 VSIRW on the three consecutive vertices —1, and 1 

This walk is equivalent to the ESIRW on two non-oriented edges linking the same pair 
of vertices, which in turn can be seen as a W- urn process with two colours —1 and 1, 
defined as follows: we start with a certain number of balls of each colour (1 if X$ = 0) 
and, at each time step, we pick a ball of colour % E { — 1,1} in the urn with a probability 
proportional to VT(number of balls of colour i), and put it back together with a ball of 
the same colour. 

Assume X = for simplicity. Let, for all n E N, 

*»<»>:= n(i+wy. (4) 

n—1 n— 1 , 

with the convention that W*{1) = W{1) := and W x (l) := 1. 
For all A > 0, let 

W^(Z n (-l))' 

and let 



M n := (^A,(A)J = a ^W*(Z n (l)) - a 0A W*(Z n (-l)). 
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Lemma 1.1 The three processes (A n (X)) n ^ , (A n (\) 1 )n3=o an d (M n ) n ^ are martin- 
gales. 

PROOF: Indeed, if X n = 0, then 

E(A n+1 (\) - A n (\)\F n ) a 0A W(Z n (l)) a ,-i 

A n (X) a 0:1 W(Z n (l)) + a ,_iW(Z n (-l)) W(Z n (l)) 

a ,-iW(Z n (-l)) ao,i 

00,1^(1)) + a 0> -iW(Z n (-l)) W{Z n {-\)) 

□ 

Let us now make use of Lemma 1X7X1 to analyze the asymptotic behaviour of the walk 
under the condition W(n) := (A + n) p , A > —1, p G R: 

1) p = 1, i.e. W(n) = n + A. 

Then W*{n) = X^fc=i + A), and W*(n) — logn converges. On the other 
hand, for all n ^ 0, 

n-l 

^(M fc+1 - M fc ) 2 = (% t _ x W(Z k (\)) + al x W{Z k {-\)) } 

k=0 

so that (M n ) n ^ is bounded in L 2 , hence converges a.s. and in L 2 by Doob 
Lemma. Therefore a _i log(Z n (l)) — a ,i log(Z n (— 1)) converges, and 

Z n (l) a °.- 1 ~ CZ^-l)^ 1 a.s., (6) 

n— >oo 

for a certain positive random variable C 

a) If a 01 = ao,-i) then the PF-urn is a Polya urn, and z nr^jjp^ converges to a 
random variable (3 G (0, 1). 

We can deduce from a classical result that /3 is a beta distribution with parameters 
(1 + 2{x =i}A, 1 + I{x =-i}A) in general (but we assumed X = here for 
simplicity) . 

b) If ao,i 7^ a,o,-i ? note that the following urn process with the same colours — 1 
and 1 could be analyzed by the technique above: at each time step, pick a ball 
in the urn with a probability proportional to the number of balls of that colour 
(as in Polya urn), and we put it back together with, in conditional expectation, 
a ,i (resp.a ,i) if we picked colour 1 (resp. —1). 

The latter model is similar to Friedman urn [6], analyzed by Freedman in [5]. 
Note that we obtain the same martingale M n (but not A n (X) for general A), and 
therefore the same asymptotics ([6]), if we assume for instance a bounded number 
of added balls. 
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2) p > 1, or more generally for any W satisfying ^2 1/W"(n) < oo. 

Then the martingale (M n ) n ^ Q converges a.s., as a difference of nondecreasing 
bounded sequences. On the other hand, 

{^(1) = ^(-1) = oo} C {Mqo = 0}. 

It is possible to prove, using estimates of the variance of the increments, that 
P(M DO = 0) = (see for instance [10]), so that only one of the two vertices 1 and 
—1 is visited infinitely often almost surely. We will show that result by another 
technique in Sectional in Proposition 13.11 

3) p < 1 (not necessarily nonnegative). 

Given A > 0, using that (A n (\)) n ^ Q is a martingale of expectation 1, and that, 
for all x ^ 0, ^ log(l + x) - x ^ -x 2 /2, 

E[exp(AM n )] < exp(X 2 W(n)/2) 

so that, by Chebychev inequality, for all a > 0, 



exp(-Aa + X 2 W{n)/2) < exp(-a 2 /2), 



choosing A := a/yW(n). 

Therefore, for all c > y/2, \M n \ ^ c\J\ognW(n) for large n a.s., so that 

ZJX) y ( Qq,i 

Z n (-1) «->oo \a Q -i 

Hence, on three vertices, the weakly reinforced walk (p G 0, 1)) behaves similarly 
as the self-repelling one (p < 0), whereas the strongly reinforced walk -i.e. with W 
reciprocally summable- implies localization on two vertices. 

In general, is strong reinforcement a necessary and sufficient condition for local- 
ization? The next subsection 11.1.21 and Section 11.31 will provide a partially positive 
answer for edge self-interaction (ESIRW), when W is nondecreasing. On the contrary, 
the results of Section [TT21 will highlight the dependence of the behaviour of VSIRWs on 
the graph structure, which also display localization on particular trapping patterns in 
the linear case W(n) — n + A, A > — 1. 

1.1.2 ESIRW on G connected, W nondecreasing, YlnmWfn) = 00 
Proposition 1.1 {\R'\ ^ 0} = {R' = G} a.s. 



P 
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PROOF: Let t n := t n (x) be the n-th visit time to x, then 

^2 z t n (x)({x,z}) = 2n + a, 

Z^X 

where a := l{x ^x} — 2 + \{z G G : z ~ Hence, for all z ~ x and n G N, 

_ 7 i n! , a^jfL 

> %<°°}^(°) Cst K,W [ w{2 l n + a) + w{2n l 1 + a) ) > 

using that W is nondecreasing. 

Therefore, using conditional Borel-Cantelli Lemma 15.14 

{Z^x) = oo} C i ^P(X tn+1 = z\F tn )l {tn<oo} = oo 1 

IneN J 
IneN 



L {tn<Oo} 



oo > C {Zoo(z) = oo} a.s. 



□ 



Remark 1.1 The condition that W should be nondecreasing is important in Propo- 
sition [TTTJ The following counterexample was proposed by Sellke [12]: if w(2k) = 00 
and J2 w(2k+i) < 00 ' a M = G = R d and X = 0, then 

P(Vn G N, X 2n = 0) > 0. 
This result will be a direct consequence of the time-lines construction in Section [3] 



1.2 Localization results, VSRIW 
1.2.1 G = Z, a id = Tl^j, W{n) = A + n 

Pemantle and Volkov [11] showed that the walk a.s. visits only finitely many vertices, 
and that it localizes on any set of five consecutive sites with positive probability. Tarres 
[13] proved that localization on fives sites is in fact the a.s. behaviour. 

Theorem 1 (Pemantle and Volkov, | |llj ) \R'\ < oo a.s. and, for any x G Z ; 
P(# = { x - 2, x - 1, z, x + 1, x + 2}) > 0. 

Theorem 2 (Tarres, [T5]) |#| = 5 a.s. 

We propose here some new proofs of these results: Theorem [1] in Section [2] (see Propo- 
sitions and [22]), using techniques derived from [T3], and Theorem [2] in Section HJ 
partially adapting a continuous-time equivalent of the random walk, originally intro- 
duced in [5EE2]. 
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1.2.2 G = Z, a id = Tl^j, W{n) ~ n a 

Theorem 3 (Volkov, [14J ) Suppose that < lim^oo Wk/k a < oo. Then 

(a) If a < 1, then R' G {0, oo} 

(b) Ifa>l, then \R'\ = 2. 

1.2.3 General (G, ~) locally finite, (a^)^- symmetric and W{n) — A + n 

Under a symmetric propensity matrix, the vertex-reinforced random walk localizes with 
positive probability on a class of complete rf-partite subgraphs with possible loops plus 
their outer boundary. We need to introduce some notation, in order to describe further 
these trapping subsets. 

Given a subset R of G, we let 

OR = {j e G \ R : j ~ R} 

be the outer boundary of R. 

For any x = (xi)i 6 G £ let 

S'(z) := G G/ a* ^ 0} 

be its support. Let 




be the nonnegative simplex restricted to elements x of finite support. 
For all x G A, let 

Ni(x) := 2j a i,i z i) H(x)= 2J OijXjXj = / ]xjNj(x). (7) 

jeG,j~i i,j£G,i~j ieG 

For all n G N, let 

be the vector of density of occupation of the random walk at time n, which has finite 
support and takes values in A. 

The following definition introduces "good candidates" for the limiting density of 
occupation of the random walk. 

Definition 1.1 For all x G A ; let (P) x be the following predicate: 

max fSp[ajj — 2H{x)\ i j eS r x \ J ^ 0, max{iVj(x) — H(x),i G dS(x)} < 0. 
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Theorem 4 (Benai'm and Tarres, [TJ) Given x G A such that such that (P) x holds 
and for any neighbourhood N \x) of x in A, there is with positive probability y G J\f(x) 
with S(y) = S(x), such that the following three events occur: 

(i) R' = S{x) U dS{x) 
(ii) x n y 

(iii) V* G dS(x), Z n (i)/n Niix)/Hix) — )■ Cj G (0,oo) ^random;. 

Assumption (P) x in Definition [7] describes stable equilibria of the ordinary differential 
equation 

£ = *■(,), (8) 

where 

F(z) = (a^z) - ff(x)]) ieG . (9) 

also known as the linear replicator equation in population genetics and game theory. 
Up to an adequate rescaling in time, we can indeed show that (xfc)fceN approximate of 
this ODE under certain assumptions. 

The support of these equilibria satisfies some properties, described in the following 
Lemma 11.21 In the context of population dynamics, they inform on the structure of 
the surviving species, depending on the nature of the graph. 

Definition 1.2 Given d ^ 1, subgraph (S, ~) of (G, ~) will be called a complete d- 
partite graph with possible loops, if (S, ~) is a d-partite graph on which some loops 
have possibly been added. That is 

S = V 1 U . . . U V d 

with 

(i) V p G {1, . . . , d}, V i, j G V p , ifi^j then i ^ j. 

(ii) V p, q G {1, . . . , d}, p ^ q, Vi G V p , Vj eV q ,i~j. 

Definition 1.3 For all 5CG, let (P) s be the following predicate: 

(P) 5 (a) (S, ~) is a complete d-partite graph with possible loops. 
(P) s (b) If % ~ i for some i G S, then the partition containing i is a singleton. 
(P) 5 (c) // V p , 1 ^ p ^ d are its d partitions, then for all p, q G {1, . . . , d} and 
h i' e V p , j, f G Vj, a itj = a V j>. 

Lemma 1.2 (Benai'm and Tarres, JiJ/j For all x G A, (P)^ implies (P)s( x )- 



S 



1.3 Localization results, ESIRW 

Let (H) be the following condition on W: 

fcGN v ' 

We know from Proposition 11.11 that, if (H) does not hold and W is nondecreasing, 
then the walk is either transient or recurrent on all vertices, assuming the graph G is 
connected. 

On the other hand, it is easy to show that (H) implies localization on a single edge 
with positive probability. Sellke [12] conjectured in 1994 that this should occur with 
probability one on any graph of bounded degree, and proved the statement on graphs 
without odd cycles. Then Limic and Tarres [9] showed in 2007 that this conjecture 
indeed holds if W is nondecreasing (Limic [8] solved the case W(k) = (k + l) p in 2003). 

Theorem 5 (Sellke [12J, Theorem 3, Limic |8J, Lemmas 1-2, Corollaries 1-2) 

If(G,~) has bounded degree and contains no odd cycles, then (H) implies \R'\ = 2 a.s. 

Theorem 6 (Limic and Tarres [9J, Corollary 3) If(G, ~) has bounded degree and 
W is nondecreasing, then (H) implies \R'\ =2 a.s. 

We explain the key ingredient for the proof of Theorem [5] in Section 13.21 

2 VRRW on Z, first localization results 

The goal of this section is to prove the following Propositions 12.11 and 12.21 which will 
in particular imply Theorem [TJ 

Proposition 2.1 (Pemantle and Volkov, 1999, 01] /) 

(a) For all x e Z, a e (0, 1), e > 0, 

¥({R' = {x - 2, x - l,x,x+ l,x+ 2}} n {tt m (i) G (a - e, a + e)}) > 0. 

(b) \R\ < oo a.s. 

Proposition 2.2 

(a) (Bienveniie, 1999, JE/) 

[R' = { x - 2, x - 1, x, x + 1, x + 2}} 

C {3a^(x) :=\ima~(x) G (0, 1)} n {log Z n (x ± 2)/ log Z n (x) — > a*(x)} a.s. 

n— >oo 

(b) (Pemantle and Volkov, 1999, UH)\R'\ > 5 a.s. 
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We will assume that A := in the remainder of this survey, so that W(n) = n; the 
proofs obviously carry on to the general case, by replacing Z(.) by Z .(.) + A, and by 
defining the following function h accordingly, on A + N instead of N. Also recall that 
djj = Ij^j here. 

Let us first explain the heuristics of the localization on five vertices with positive 
probability. Let us assume for instance that the that the walk started at 0, and that 
we are in the following configuration at time n, represented by the figure below: site 
has been visited n/2 times, its neighbours —1 and 1 have shared the other half of 
time, and have been visited respectively roughly an/2 and (1 — a)n/2 times for some 
constant a G (0, 1); that the two sites —2 and 2 have been visited of the order of Cn a 
and C'n x ~ a and, finally that —3 and 3 have not been visited yet. 

The numbers above the sites on the figure represent the estimates of the numbers 
of visits (plus one). 

1 Cn a an/2 n/2 (1 - a)n/2 Cn 1 '" 1 



-3-2-10123 

Assume X n = —1 for instance. First, the configuration would not be viable asymp- 
totically for an edge-reinforced random walk (ERRW), since 

p(x n+2 = -3|jg , 



>oo an 2Cn a n->oc an 

so that —3 would eventually be visited, by conditional Borel-Cantelli lemma. 

On the contrary, for the vertex-reinforced random walk we are considering, the same 
computation yields 

Cn a 1 Cst(C, a) 



P(A n+ 2 — — 3\J-,, n ) 



>oo n/2 an/ 2 n->oo n 2 ~ 



Therefore, with lower bounded probability, the sites —3 and 3 will never be visited, 
as long as the same asymptotics holds for the visits to the other sites. Now, under 
these assumptions: 

• The visits to —2 and 2 are seldom, so that the respective visits to —1 and 1 can 
almost be estimated by considering the walk on the three vertices —1, and 1, 
restricted to its moves to and from 0, described in Section 11. 1.1 1 we are in Case 
l)a), so that Z n (—l)/(Z n (—l) + Z n {l)) should remain close to a. 

• The respective visits to —2 (similarly 2) and can be seen as stemming from a 
Friedman urn model, Case 2)a) of Section 11.1.11 Indeed, starting from —1, the 
sites —2 and are chosen proportionally to their numbers of visits. But, if —2 is 
picked then the walk immediately comes back to —1, whereas if is chosen, the 
expectation of the number visits before coming back to —1 is roughly a -1 : (J6]) 
would provide convergence of Z n {— 2)/Z n (0) a . 
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The following results indeed justify this heuristics, and will also be useful in the 
proof of a.s. localization on five points. They are similar to those developped in Sections 
1, 2 and 3 of [H]. 

Let, for all nGN, 

n— 1 _. 

h(n) 

k=l 

with the convention that h(l) := 0. For all n G No and i6Z, denote 

n 

Z n( x ) '■= / ] t{X fc _i=iE y y fc =a ! ±l}) 



a£(x) := 



fc=i 

z„,(x±r 



Z n (x - 1) + Z n (x + 1) ' 
n 1 

fc=l " 1V 7 



also 



n 1 

y„(x) ;= g V,-i-} Zfc _ i(x _ 1) + Zjk _ i(x + 1) ' 



fc=l 

K^fx) := K^x) - y n (a; 



which are respectively the previsible and martingale part in the Doob decomposition 
of Y^(x), and finally 

:= lim y±(x), y oo (x) := lim y n (x). 

n— >oo n— >oo 

Given (a n ), (6 n ) random processes on R, we write a n = b n iff a n — b n converges a.s. 
Let us define the probability event 

T(x) := {yoo(x) < oo} 

and, for any finite sequence (x^i^n taking values in Z, the event 

T((xi) 1<i<n ) = p| T(xi). 



ls£js£n 



2.1 "Polya urn" estimates 

The event T(x) corresponds to the event that x is "seldom" visited (represented by a 
cross on the figure), hence "neutral" with respect to its neighbours, in the following 
sense: the respective visits to x + 1 and x + 3 starting from x + 2 can be seen be seen 
similar to those of a Polya urn model (see Section fl .1.11 study of case l)a)), perturbed 
by the visits from x and x + 4: T(x) implies that the visits from x do not act upon the 
asymptotic behaviour of a~(x + 2), as stated in Corollary 12.11 
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x • • • 



Proposition 2.3 For all x G Z ; 

(a) ^(x) = Y^(x) — Y n {x) is a martingale, converging a.s. and in L 2 

(b) Y±(x)=Y n (x) 

(c) E((Y n (x) - Y^x)) 2 ^) ^ Cst Z n (x ± l)- 1 

(d) Y+(x - 1) + + 1) = h(Z n (x)) - h(l + I { x =, } ) = hgZ n (x) 
PROOF: It follows from its definition that (Y^(x)) n ^o is a martingale. Now 

V3r(Y± +1 (x)\T n ) = Var^x)^) < E((F n ± +1 ( a ;) - Y^x)) 2 ) 

_ F / R{X n =X,X n+1 =X±l} I F 

V ^±i) 2 1 n 

Hence, for all m ^ n, 

\k=n KK ' / l=Z n (x±l) nK ' 

This implies (a)-(c); (d) follows from definitions. □ 
Let, for all t G (0, 1), 



Let, for all a > 0, m ^ 0, y G Z, let £ m>a (y) be the event 



£»,«(l/):={ SU P [/(«;(y))-/K-(y))-(r n (y-2)-n(y-2))]>a). (10) 



Corollary 2.1 For all x <E Z, n ^ m, a ^ Cst, 

(a) T(x) C {3a~ (x + 2) := lim<(x + 2) G [0, 1)} n {log/(a£(s + 2)) = -Y~(x + 4)} 

(b) T(x) n {a" (a; + 2) > 0} C T(x + 4) 

(c) P(£ m , a (x + 2)\T m ) < Cst(a) (Z m (x + l)' 1 + Z m {x + 3)- 1 ) 

(d) T(x - 1, x + 1) C {^(x) < oo} 
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PROOF: (a)-(b) By Proposition [2]3] (b) and (d), a.s. on T(x) = {Y~(x) < 00} , 

hgZ n (x + 1) = Y+(x) + Y'(x + 2) = + 2) = logZ„(x + 3) - Y~(x + 4), 

so that 

log /K (x + 2)) = log ± ^ ee _y- (x + 4). 

(c) By Proposition 0(d), 

h(Z n (x + 1)) - h(l + l {Xo = x+ i } ) = Y+(x) + Y~(x + 2) 
= Y n (x) + Y+{x + 2) + Y+(x) + F n -(x + 2) - Y+(x + 2) 
= y n (x) + h(Z n (x + 3)) - h(l + l{x =z+3}) ~ Y~(x + 4) 

+ Y+(x) + Y-(x + 2) - Y n (x + 2). (11) 

In order to estimate the probability of S mia (x + 2) we observe that, if a ^ Cst, then 
f(a-(x + 2)) - f(a-(x + 2)) = log ( X ' l[ f ' - log ' Z " ( '' 



z m (x + i)y vz m (x + 3) 

^ fc(Z n (x + 1)) - fc(Z m (x + 1)) - [h(Z n (x + 3)) - h(Z m (x + 3))] + ~ 
using that, for any large q ^ p, 

- — ^ log 2 -(h(q)-h(p)) <0, (12) 
p p 

as 1/p — l/p 2 ^ log((p + l)/p) ^ 1/p for large p. 

We subtract identities (TTTj) at times n and m, and note that the terms Y+(x) — 
Y+(x), Y~(x + 2) — Y m (x + 2) and Y m {x + 2) — Y n {x + 2) can be upper bounded by 
a/4 with large probability, by Doob and Chebychev inequalities, and Proposition 12.31 
(c), for instance: 



P 



( sup(f+(x) - y+(x)) ^ Jj-J ^ ^E((y B (x) - Foo(x)) 2 | J-n) < Cst 



a 2 Z m (x ± 1) 



which completes the proof. 

(d) It is a direct consequence of Proposition 1231 (b) and (d): a.s. on Y(x — 1, x + l), 

logZoo(x) =Y+(x- 1) +Y~(x + 1) <oo. 

□ 
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2.2 "Friedman urn" estimates 

The main goal of this subsection is to provide estimates for the number of visits to 
x + 1 when a~(x + 3) converges to a" (a; + 3) > 0, and T(x — 1) holds, i.e. x — 1 
is "seldom" visited. The Friedman urn dynamics, which arises for sites x and x + 2, 
appears through the following calculation, justified rigourously in this section: 

x — x • • • 

x — 1 x x+lx+2x+2 



n -u 

-li{X fc _ 1=a; +l,X fe = a; +2} 



logZ n (s) ^ + 1) = + 1) = 7( *7^ 

fc=l fc=l 

For all x G Z, n G N, a > 0, let 

n ~fT 



t£ ± (s) := J2 



k=l 



Zk-i(x) 



rj- / x = ^{Xk.^x^^xTl} Z k -l(x + 1) 



and let 



l{x fc _ 1=a; } ± 



UnAx) '-^^r^T^- 1 

U^(x) :=U%±(x)-U n ±{x) 
be respectively the martingale and previsible parts of the Doob decomposition of 

Note that the processes U~±(x) and U~±(x) will not be used in this section; they 
will be necessary tools to the proof of a.s. localization in Section HI 
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Proposition 2.4 For all x G Z, C , a, 7 > 0, n G N, 

(a) n i-> Y^fx) H {±^^±3:} _ u+( x _(_ ]_) j s a s constant 

Z n _i(x ± 1) ' T 

(b) [/^.(x) converges a.s. and in L 2 , and 

E((U+ ± (x) - f>+, ± (x)) 2 |J-n) < CstZ^x)- 1 

(c) T(x — 1) n {Zoo(x) = 00} n {limsup a~(x + 2) < 7} 

CT(x-l,x)n{logZ n (x) ~ a^(x + 2)logZ n (x + 2)} 

n— >oo 

(d) Assume Z m ^ CZ m (i + 2) a , and let 

T := inf{n ^ m s.t. a~(x + 2) ^ 7 or X n = 2 — 1}. T/ien 

P ( SU P v f" (X L ^ e a C\J m ) ^ Cst(a)(Z m (x)- 1 + Z m (x + 2)- 1 ) 

\T>n^m A n {X + A)' J 

PROOF: (a) Assume ± = + for simplicity. Now the function of n only changes when 

- X n _i = x and X n — x + 1, in which case Y+(x) increases by Z n -i(x + l) -1 

- X n _! = x + 1 and X n = x, in which case U^_(x + 1) increases by Z n _i(x + 

(b) is similar to Proposition 12.31 (c) 

(c) Note that 

log Z n {x) = Y+(x - 1) + Y~(x + 1) = Y+{x - 1) = + 2) = C^_(x + 2) 

^ Z fe _ 1 (x + 2) 

for large n if limsupo;~(x + 2) ^ 7 and Z^x) = 00. This implies a^(x + 1) ^ 
(Z n (x) + Z n (x + 2)) 7+ ^ 1 *C Z n (x + l)T+e-i for krge n e N? go that 

y-ooCi) = f+(x) = u- n ,_(x + 1) = J2 y fTii ^ + 1) < 00. 

(d) Similarly as in Corollary 12.11 (c), outside of an event of probability less than 
Cst(a)(Z m (x)~ 1 + Z m (x + 2) _1 ), we have 

log (%&\) < - 1) - - 1) + a + sup 0^(2 + 2) log f ^ftoO " 

\Zj m {X)J m^k^n \^m\X + ^) J 

□ 



2.3 Conclusions 

2.3.1 Proof of Proposition [Ml 

(a) A.s. on {Z^ix + 3) < 00} fl {Z OQ (x — 3) < 00}, T(x — 3, x — 2, x + 2, x + 3) 
holds by Proposition [23] (b). Hence — > ®oo(, x 

) G [0,1) by Corollary ED (a), 
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which also implies cx^x) G [0, 1) by considering the sites in the reverse order, so that 
a oo( x ) £ (0, 1). Finally Proposition 12.41 (c) completes the proof. 

(b) A.s. {R! C {x,x + l,x+2,x + 3}}n {Z^ix) = oo}, Corollary O (a) implies 
a~(x+2) — > a~^ (x + 2) G [0,1); subsequently, a~(x+l) — > by Proposition I2~4l (c). 

On the other hand, T(x + 3) holds, so that a+ (x + 1) — >■ «+ (x + 1) G [0, 1), which is 

contradictory. 

2.3.2 Proof of localization with positive probability 

We will prove the following result of localization on a half-axis. 

Corollary 2.2 For all x G Z, 7 G [0, 1), e > 0, C > 0, m G N, assume Z m (x±3) = I, 
Z m (x ± 2) ^ CZ m (i) 7 and a;* (a;) ^ 7. T/ien 



P {^(x ± 3) ^ 1} U {sup a±(x) > 7 + e}\JF m U Cst( 7 , e, C)(Z m (x)^+Z m (x±iy 

\ n^m J 

PROOF: Assume ± := — , X m ^ x — 1 and e < 1 — 7 for simplicity. Let T\, T 2 and T 3 
be the stopping times 



T 3 



inf{n ^ m s.t. Z n (x — 3) > 1}, 

inf{n ^ m s.t. o^(x) ^ 7 + e} 

inf{n ^ m s.t. Z n (x - 2) ^ Ce e Z n (a;) 7+e }. 



First, if Z m (x - 2) ^ Cst(C, e), 

^ ^ ^(Z b (i-1)-1)HtH) 

k=Z m (x-l) V mV ; ; 



(13) 



Second, 

P(T 2 < T x A T 3 | JT m ) <; F(E m>e/2 {x)\T m ), (14) 

where £.,.(.) is defined in (fTUj) . Indeed, assume £ m>e / 2 {x) holds. For all n ^ m, let p(n) 
be the last time k s.t. a£ (x) ^ 7. Then 



n tt ra ir 

fe=p(n)+l v 7 fc=p(n)+l v 



again if Z m (x — 2) ^ Cst(C, 7, e). 
Third, 

P(T 3 < 7\ A T 2 | J- m ) = E[P(T 3 < 7\ A T 2 |.F s )l[ {s<oo} ], (15) 
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where 

S := inf{n ^ m s.t. Z n (x — 2) ^ CZ n (i) 7 }. 
By Proposition (23 (d) , 

P(T 3 < T a A T 2 |J- 5 ) < Cst(e)[Z s (z - 2)" 1 + Zsix)- 1 ] < Cst(C, e)Z m (x)^. (16) 

Now inequalities ({TBI . (|T4l) . ( 1T51) and ( fT6l) enable us to conclude. □ 

2.3.3 Proof of Proposition [27D 

(a)For all n ^ Cst, e > 0, a G (0, 1), 

P({Z„ 0+x .(x - 2) = Z„ 0+:c (x + 2) = 2} n {Z„ 0+iE (x - 1) G ((« - e)no/2, (a + e)n /2} 

n {Z no+x .(x) G (1/2 - e, 1/2 + e)n }) ^ Cst (no). 

Now apply Corollary 12.21 twice, with ± := + and ± := — , and Proposition 12.21 

(b) For all x ^ Xq, let us prove that P(x — 2 ^ i?|a; G -R) ^ e > 0, which will imply 
the conclusion. For all n G N, let u no (x) be the first time t such that Z t (x) = n , and 
let t(x) be the time of first visit to x. Then 

n{Z Uno{x) (x - 2) = Z Uno(:c) (x - 1) = 1} n {^„ o( ,)(x + 1) ^ n }) ^ Cst(no). 

Now apply Corollary 12.21 with x := x and ± := — . 

3 Rubin continuous time-lines construction 
3.1 W-urn 

Again consider PF-urn process with two colours —1 and 1 studied in Section [HUH 
defined as follows: start with Zq(1) and Zq(—1) balls of colours 1 and —1 respectively. 
At each time step n ^ 0, pick a ball of colour % G { — 1,1} in the urn with a probability 
W{Z n {i))/{W{Z n {-\)) + W(Z n (l))), and put it back together with a ball of the same 
colour. 

time-line of 

i . . . . _1 

I . . . — . .. ► 1 

We now construct a continuous-time process (Z t (l), Z t (—l)) teK+ taking values in 
N 2 , which will be equal in law to (Z n (l), Z n {— l)) ne jj, seen from the times of jumps. 
To this end we add balls of colour i G {—1, 1} at rate W(Z n (i)), using the following 
time-lines construction: 
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• Let (Y k 1 )a ;6 n and (Y£)k£N be two sequences of independent random variables of 
exponential law with EY£ = W(Z (i) + k — independent from each other. 

• Each of the colours 1 and —1 has a clock with an alarm, set initially to Y"/ and 
Yf 1 respectively. 

• Each time an alarm rings, we add a ball of the corresponding colour, say i. The 
other clock —i keeps running, while the new alarm with i is set at at time distance 
Y k l +l if k balls of colour % have already been added in the urn. 

More precisely let, for all i G { — 1, 1} and t G M + , let 

5 1 :=|^^,neNj,S':=S' 1 US'_ 1 , 
let £ n be the n-th smallest element in S, with the convention that £ := 0. and let 
Z t (i) : = sup jz > s.t. J2 Y k < * J + Z o(i)- 



Lemma 3.1 The processes (Z^(l), Z^ n (-l)) n>0 and (Z n (l), Z n (-l)) n>0 (from a W- 
urn) are equal in law. 

PROOF: By memoryless property of exponentials, for all n G N, the joint law of the 
first alarms after time £ n in the time-lines —1 and 1 (conditioned on their past up to 
that time) is a couple of independent random variables of parameters W(Z^ n (l)) and 
W(Z^ n (— 1)) respectively. 

Now, if U and V are two independent random variables of parameters u and v, then 
¥[U < V] = u/(u + v ), which completes the proof. □ 

This result enables us to conclude that, if W is reciprocally summable, then only 
one of the balls is taken in the urn infinitely often. 

Proposition 3.1 If X]jfceN < oo ; then Z^l) < oo or Z^— 1) < oo a.s. 

PROOF: We have 

(oo OO \ 

En 1 = En _1 
k=l k=l J 

(oo oo \ 

k=l k=2 J 

since has continuous density, independent from X^fcLi^/T 1 ~~ S/rf^fc 1 - ^ 
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3.2 ESIRW on a locally finite graph (G, ~) 

Let us similarly construct a continuous-time process (X t ) te ^ + , which will be equal in law 
to (X n ) n ^ for ESIRW, seen from times of jumps. Let E(G) be the set of (non-oriented) 
edges of (G, ~). The process starts at X := x at time 0: 

time-line of 

i . . . «^ ► e 

Y fo ye + y 2 eo 

i . . . «. — — ► ei 

ye x yei + ye x 

I . . . . • • ► e 2 

ye 2 ye 2 + ye 2 

I . . . . . » e 3 

yes ye 3 + yes 

• Let (y fc e )ee-E(G),fceN De a collection of independent exponential random variables 
with EY fe e = W(k-l)- 1 . 

• Each edge e has its own clock, which only runs when the process {X t ) t ^ is 
adjacent to e. 

• Each time an edge e has just been crossed, and at time 0, its clock sets up an 
alarm at distance Y£ +l if e has been crossed k times so far (Y{ at time 0). 

• Each time an edge e sounds an alarm, X t crosses it instantaneously. 
Let r n be the n-th jump time of (X t ) t ^ , with the convention that r := 0. 

Lemma 3.2 (Davis J^j, Sellke ITBJ ) The processes (X Tn ) n ^ and (X n ) n ^ have the same 
distribution. 

The proof of Lemma [3.21 is left to the reader, being similar to that of 13.11 
Let 

Goo ■= {e G E(G) s.t. Zoo(e) = oo}. 



Proposition 3.2 If J2 n eN^/^( n ) < 00 > then contains no even cycle. 

PROOF: For simplicity, let us denote an even cycle by Z/ZZ, I even. Let, for all i G Z/ZZ, 



k=l 

Then 



oo 

{i,i+l} 

k 



{z/izcg^c } (-1)^ = 
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Now J2 xe z/iz(~ 1) X T X 7^ a.s., which implies that 

P(z/fficg = o. 

□ 

The technique carries over to show [12], |8] that, on graphs on bounded degree and 
if W is reciprocally summable, then is either a single edge or an odd cycle. 

4 Short proof of a.s. localization of the VRRW on 
Z on five consecutive sites 

Let, for all x E Z, 

tt(x) = {iniR' = x}. 

Then 

F(u xez n(x)) = l, 

by Proposition 12.11 (b), which asserts that the walk a.s. localizes on finitely many 
vertices. The aim of this section is to prove the following two propositions. 

Proposition 4.1 For all x E Z, T(x) C {Z OQ (x — 1) < oo} U {Z OQ (x + 1) < oo} a.s. 

Proposition 4.2 For all x E Z, fl(x) C T(x + 4) a.s. 

These will imply Theorem [2j i.e. a.s. localization on the VRRW on five consecutive 
vertices: a.s. on Q(x), Z^ix + 3) < oo or Z OQ (x + 5) < oo by Propositions 14. II and 14. 2\ 
and the former would imply that R' = {x, x + l,x + 2}, which holds with probability 
by Proposition O(b). 

We first propose an alternative time-lines construction for VRRWs in Section 14.11 
which will enable us to couple two random walks in Section 14.21 with the following 
property: we will say that M! is greater than Ai if, at the time of n-th visit to any 
site x E Z, M! has more visited the right-hand side neighbour x + 1 than Ai, whereas 
on the contrary Ai has more visited x — 1 than A4' . Then we will prove Propositions 
IP and S~2] in Sections 0~3] and H3J 

4.1 An alternative time-lines construction for VSIRWs on Z, 

We introduce the following time-lines construction on directed edges E(Z) of Z, which 
will enable us to introduce naturally a coupling in Section |4T2] If e = (x, y) E E(Z), 
let e := x, e := y, <r(e) := (y,x). 

The continuous time process (X t )tm+ taking values in Z will be defined as follows: 

• Let (Xk)eeE(z) fceN ^ e a collection of independent exponential random variables 
with expectation one. 
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• Each oriented edge e G E(Z) has its own clock, which only runs when the process 
{X t ) t ^ is adjacent to e. 

• Each time an edge e has just been crossed, the clock of <r(e) sets up an alarm 
at distance /W(Z t (e)), if o~(e) has been crossed k times so far. At time 0, 
we set up an initial alarm, at time distance Yf, for the edges (x, x + 1), x ^ xo, 
(x, x — 1), x ^ Xq. 

• Each time an edge e sounds an alarm, X t crosses it instantaneously. 
Let r n be the n-th jump time of (X t ) t ^ , with the convention that r := 0. 

Lemma 4.1 The processes (X Tn )„^ an d {X n ) n ^ have the same distribution. 
The proof of Lemma 14.11 is again left to the reader. 

4.2 Coupling 

Let us denote by A4 the function which maps a (deterministic) "collection of alarms" 
y = {Y£) e< -£^ keN and an initial site xq to a continuous-time (deterministic) walk 
M.{y,Xo) on the vertices of Z, as prescribed in Section POl 

Definition 4.1 Given y = (Y k e ) eeS(z)iken and y = {{Y')%) e&S[Z))km two collections 
of random variables on E +; we say that y ^>y if, for all k G N , x G Z, (y)^ ,:c+1 ) ^ 

Given y = (Y k e ) e( . g{mm and y = ((Y%) eeg(z)jken two collections of random 
variables on R + we let, by a slight abuse of notation, M. = (X t ) t ^ + := A4(y,x ) and 
M! = (X f ') te R + := ^(y, Xo) be the continuous-time random walks starting associated 

to y and y. 

For all i G N, w > 0, j G Z and e G £7(Z) (resp. e G E(7j)) non-oriented (resp. 
oriented) edge, let n e (i) be the i-th visit time to e, let lj(t) be the local time at j at 
time t, let £?(«) := inf{£ ^ s.t. /j(t) = u}, and let 7} be the total time spent in j for 
the random walk A4; let n' e (i) and T- be the similar notation for .A/f. 

For any non-oriented edge e = {j,j + 1}, let e := j + 1 and e:=j. 

Definition 4.2 For all i £ N and e G E(7i), let us define the property E i>e as follows: 

z k(i)(e) > z n e (i)(e) and Z' <{i) {e) < Z ne(i) (e), 

with the convention that E^ holds whenever n e (i) = oo or n' e (i) = oo. 

Lemma 4.2 Assume y ^> y , and W is nondecreasing. Then, for all i 6 N and 
e G E(Z), E i>e holds a.s. 
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PROOF: Let, for all T > 0, 



V T := {e G E(Z), i e N s.t. n e (i) < T and ri e (i) < T, £7 iie holds}. 

Note that the property "Py can only change on a discrete set of times; we prove it by 
induction. Assume that holds, i.e. that Vt holds for all t <T. We want to deduce 
Vt'- assume for instance that n e (i) = T, n' e (i) ^ T, with e = {j,j + 1}, j ^ xq, and i 
odd, so that X Ue ^ = X' n ,,* = j + 1 (the other cases are similar). Obviously, 

Z' n ' e (i)U + 1) = Z k(i-l)(j + 1) + 1 > Z ne{l) (j + 1) = Z ne(i _ x) (j + 1) + 1. 

It remains to prove that 

^ e(i) 0') < Z n ^(j). (17) 

Let /j := lj(iii(e)) — Zy(nj_i(e)) (resp. Z^) be the local time spent at j between times 
n e (i — 1) and n e (i) (resp. n' e {i — 1) and n' e {i)). Then 

vO'J +1 ) /y/\(w+i) 

' w(z Mt . 1} (j + 1)) - wiz^u + 1)) 

Let 

u := inf{0 < s < s.t. Z^ (<( . )+s) (j) > % ne(i)+s) (j)}. 

Let us now consider the last jump occuring strictly before the local time at site j is u: 
it has to be a move from A4', from j and j — I and back (possibly with a simultaneous 
move from M). At that last time, the numbers of visits to — 1) are equal for M. 
and M.' (since those of j and + 1) are) and, by V?, the numbers of visits to j — 1 
is greater for A4 than for A4'. Consequently Ai must move before A4', in j-th local 
time, after that last jump before u. Therefore u > Z'-, and Vt holds. □ 

4.3 Proof of Proposition 14.11 

Fix xGZ, Let ^ := (Yk) eE E(z) feeN ^ e a collection of independent exponential random 
variables with expectation 1, and let 

y := ((y ^)|) ee £»( Z ) jfceN := Qjb + I{e=(x,3;-l)}2{A:=„}) eej g( Z ) >fceN . 

Let M = (X t ) tm+ := M(y,x ) and A4' (ri) = (^) teR+ := M(y',x ), and let us use 
the notation from Section 14.21 
Let 

Q := {Z^x + 1) = Zjp - 1) = oo} n {T x < oo}, 
Q'W := {^(s + 1) = Z^s - 1) = oo} n {T' x < oo}. 
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Lemma 4.3 For all tieN, F(Q n Q' (n) ) = 0. 

PROOF: If Z x (x + 1) = Z^(x - 1) = Z'J^x + 1) = Z'^ix - 1) = oo and T x < oo, 
T' x < oo, then 

n v (x,x+l) n v (x,x—l) 



T = V ^ = V 



and, using Lemma [4.21 

which is contradictory. □ 
Let J-" n := ct(Xq, . . . , X n ) C cr(Y" fc e , 1 ^ ^ n). Then Lemma [4.31 implies 

P(Q c U(Q' (n+1) ) c |J- n ) = 1. 

But 

P(Q c |^n) ^e- 1 P((Q'( n+1 )) c |J- n ), 

so that 

P(Q C |-F„.) ^ (l + e)- 1 . 
Now P(Q c |J r „) — )• Igc a.s., so that Q c holds almost surely. 

n— >oo 

4.4 Proof of Proposition 14.21 

By Corollary O (a)-(b), for all x G Z, 

C T(x) C T(x)n{a;(x+2) — ► a~ (x + 2) G [0, 1)} C T(x+4)U{a^(x+2) = 0}. 

n— >oo 

Therefore, if we let 

U(x) := fl(x) n {a~ + 2) = 0}, 

it is sufficient to show that ¥(fl,(x)) = 0. 

Let us assume x := for simplicity. Our proof relies on the study of the asymptotic 
behaviour of logZ n (3)/Z n (2): roughly speaking, we will show that this quantity must 
converge to on Q(0) but that, on the other hand, its convergence to can only happen 
with zero probability, due to unstability. 

For all n G N and x G Z, let 

R n := Z n (A) + Z n {2) - Z n (l) - Z n (3), 
Z n (3) R n 



Z n (2)' Z n (2)Z n (3Y 
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and let t n (x) (resp. f^(x)) be the n-th visit time of x (resp. (x,x ± 1), counted once 
the edge has been visited), and let Z^(x) be the number of visits of the edge (x, x ± 1) 
at time n. 

Note that, for all i G N, 

Ri = Zr(5) - Z?{0) + l {Xi=2 or x&*} + Cst(xo), (18) 

so that 

R tf{2) = Z+ {2) (4) - Z; f(2) (l) + Cst(x ). (19) 

For all a G (0, 1) and k ^ j, we write j ^ a k if, for all % G [j, k), « 4 7 (2) V a^~(3) ^ a. 

Lemma 4.4 Assume Z n (2) ^ Cst. Then there exist ao := Cst, (Vj,k)k^j^n o,nd (rj^k^j^ 
such that, and k ^ j ^ n with j <H- ao k, 

k 

z k ~ z j = ' S -{x i -x=2,x i =z}Vi + Vn,k + r n ,k, (20) 
i=j+l 

where, for all a ^ a and e > 0, 

/ \ a Cst 

P sup l^fcll^fc ^ e|J" n < Cst |r ijfc | ^ — — . (21) 

\k^j^n J e Z, n {Z) 

Lemma 14.41 is proved in Section 14.4.11 

Lemma 4.5 H(0) C {]imsup(a!+(3)/a£(2)) < 1} n {£ l%+ (2) l%( 2) <oo < °°}- 

Lemma 14.51 is proved in Section 14.4.21 

For simplicity we will use the notation t n := t%(2) until the beginning of Section 
14.4.11 Let Ei := {(2, 1), (0, 1)} be the set of edges pointing to 1. We introduce the 
continuous-time construction of Section H~T1 in order to analyze the walk after time t n , 
but modify the rule for the two edges in E\\ each time an edge e G o~{E\) has been 
crossed, we set up an alarm on a(e) at time distance V k +\ if site 1 has been visited 
k times after time n. The walk thus defined depends on the sequences (Y k e ) ee g(x)\Ei^ 
(Vk)keN and on the starting point X tn . 

Let (^fc e ) eg ij(z)\_Bi ( res P- (C^')l)ee£(z)\£i) ^ e collections of independent exponential 
random variables with expectation one, and let {y k )k&i (resp. {V^)k&i) be sequences 
of independent exponential random variables with expectation EV^ = (uq + k — 1) _1 
(resp. E V k ' = (no + k — l) -1 ); these define two continuous-time walks M. and M.' . We 
choose n := Z tn (l) and n := Z tn (l) - ay/Z^l). 

Note that both Ai and .M' are continuous-time versions of a VRRW: Ai of the 
original walk (X k ) k ^ tn , and .A/f of the VRRW := (X' h ) k ^t n taken after discounting the 
number of visits to 1 of a a/ Z tn (l). 
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Given e > and n G N, assume a t (2) < e, and let 

T n : = inf{fc ^ t n s.t. a+(3) V c£(2) ^ (1 + e)a~(2) 

or ^ |yi-i|l{x i _ 1 =2,x i =3} > e or X k = 0}. 

i=fc+l 

/ 

We let Z'(.), z' , R', T', Q (0) and t! be the notation for M! equivalent to the one 
already defined for M.. 
Let 

Q n := O(0) n {T n = oo}, 

s::=n'(o)n{T,; = oo}. 



Lemma 4.6 If e sC Cst, Z f „(l) > Cst and a ^ Cst, then P((Q„ n Q^) c | J* t J ^ Cst. 
Lemma 14.61 is proved in Section 14.4.31 

Lemma 4.7 For all 5 > 0, there exists C(a,S) (depending only on a and 5) such that 

Lemma 14.71 completes the proof of Proposition 14.41 indeed, using also Lemma 14.61 for 
all n G N, 

Cst < F(Q c n I + n(Q' n ) c I Ft*) < (1 + C(a, *))P(Q£ | + 5, 

which implies F(Q c n \ F tn ) ^ Cst(a) if we choose 5 sC Cst. Now P(Q^ | J* t J — ► I Qo a.s., 

so that Q n holds a.s. Now lim inf n ^.oo Q n = ^(0) c > since T n = oo for some n on O(0), 
using Lemma 14.51 and Corollary 12.11 (a) . 

PROOF: There is a one-to-one correspondence between {Vk)k& and a simple birth 
process {N t ,t ^ 0} with initial population size no, defined by 

N t := n + sup jfc G N s.t. ^ t J . 

By a result of D. Kendall |7j, {Ni og n +t / W ),t ^ 0} is a Poisson process with unit param- 
eter, where W := limiV 4 e _ * is a Gamma random variable r(n , 1) with shape n and 
scale 1. 

The same remark applies to (V[)k&- Now recall that U ~ T(A, 1) has density 
4>\{x) := x A_1 e _:c /r(A) w.r.t. Lebesgue measure C(dx), expectation and variance A. 
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Assume A ^ 1; for all a, c > 0, there exist Ci, C2 := Cst(a, c) such that, for all x such 
that |x — A | ^ cV\, 4>\{x) i l( Px-^/x a ( x ) e [ c i; c 2]- Hence, for any Borel subset A of R, 



P(W 6i)^ P(|W - n' | ^ V^oc) + P(^' e -4 n [no - y/n' c, n + ^n' c\) 
^ c- 2 + Cst(a,b)¥(W e A). 

We conclude by choosing c := <5~ 1//2 . □ 
4.4.1 Proof of Lemma 14.41 

Assume j <r> ao k, with at ^ Cst. Let us first estimate h(Z k (3)) — h(Zj(3)): using 
Proposition 12.41 (a), there exists a constant C > such that 

KZ h (3)) = Y+(2) + F-(4) = F+(2) + U+ + - Mgt + C 

But 

^+( 3 ) = f/ fe ; + ( 3 ) + ^+( 3 )- 

Now we estimate U^,(3). We assume Xq ^ 2 (the other case is similar): then, for all 
% E N, tj{2) < V(3) < t? +1 (2), and Z tr(3) (x) = Z t + i(2) (z) for x = 3,4, so that 



% (3 )(4) 



^ + (3)"^ + (3)= £ z 3 w m 
Z g ( % +1 ( 2 )( 4 ) , % +1 ( 2 )( 4 ) 



where 



if at < Cst. 

In summary, 



fl{X,-i=2,*,=3} ^-l(4) ! 

^ Z,_!(2) Z H (3) + 



|r) fc | ^ 2 sup ( 



i < i 



^(3)7 Z,-(3) ^ 22,(3) 



, Z7 ~ 3)+1 \% +1 (2)(3)^+ 1 (2)(2) ^+ +1 (2)(3) \%(3)( 2 ) Z *+ +1 (2)( 2 ) 



^'(3) jfr^j Z J _i(2jZi_i(3j 
where |r? fc | < 3/^(2), using (JT2J. 
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Similarly, 



z i( 2 ) jf^i z i-i { 2 ) z i-i ( 3 J 



where |r| fe | < 3/^(2). 



3 

Now, if a ^ Cst, then 

k k 



1=3 1=3 



S {X;_ 1 =2,X;=3} < 2 

3(2)^(3) "^(2) 



This provides fl20|) . letting 

Vjtk := t/ fci+ (3) - U j>+ {3) - (C/ fc> -(2) - C/ i> _(2)). 

Let us now estimate The following Lemma I4TB1 will enable us to conclude, using 
Chebyshev's inequality. 

For all n G N, x G Z and a > 0, let 

£/„,±(x) := ?7+ ± (x) - U~±(x) 

n 
k=l 



Lemma 4.8 For all x G Z, k ^ n, a ^ Cst, 

E (sup (£4,±0) - C/n,±(^)) 2 |^n ] < CstaZ n (a:)- 1 . 
PROOF: (U n ,±{x)) n ^o is a martingale, and 

E((U k+l , ± (x) - L> fcl± (x)) 2 |^) < fa + < 2afe^, 

which enables us to conclude by Doob's inequality. □ 

4.4.2 Proof of Lemma 14.51 

Given e > and n G N, let 

T n := M{k > n s.t. otfc (2) > (1 + e 2 )«;(2) or F+(0) - F n + (0) > e 2 }. 
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Let us first prove that, for all e > and sufficiently large n G N, if 

a+(3) > (1 + e) 4 a;(2) with a'(2) < e 2 < Cst, (22) 

then 

P({T n < oo} U {liminf a£(3) > 0}|J" n ) ^ 1/2. (23) 
This will imply the first part of the inclusion. Indeed let, for all p G N, 

A:= {limsup(a+(3)/a*(2)) < 1}, 

fc— >oo 

£p := {T p < oo} U {liminf (3) > 0} U {limsupo^ (2) > 0}. 

Then ([23]) implies, for all p G N, that for large n G N, 1/2 ^ P(.A U B p \F n ), which 
converges a.s. to 1aub p as n — )• oo, so that AUB P holds a.s.; subsequently ^.Uliminf £> p 
holds a.s. Now, by Proposition 12.41 (c) and Corollary 12.11 (a) and (d), 

H(0) n {liminf a£(3) >o} c H(o) n T(-l, 0, 1) = 0, 

which implies f2(0) C limsupi3p C A and enables to conclude. 

Let us assume f[22l . and «+(3) ^ e 2 w.l.o.g (possibly by choosing n larger), and 
show (j23J. Fix a := (1 + e) 4 a~(2), and let p be the largest i G [n + 1, k] such that 
«r x (2) > a or at x (3) > a; then a+(3) > (1 + e) 2 a~ (2). Note that, for all i ^ p, 
Zi(2)/Zi(3) > a; (3) ^ 1 - e 2 , since Z<(3) s= Z<(2) + Z<(4). 

Let := tj"(2) for simplicity. In order to make use of Lemma 14.41 we need to 

Z~^~ (2) 

estimate , n 2/t,- Now, for all i ^ p, using ([18]), 

J — Zjp [Z)-}-L 

> - (3+(0) - Z+(0)) - 1. (24) 

On one hand, 

^(2) Z+(2)-Z+(2)-l 

i=|S) + i ^)V3) ^ g (Z p (2)+j)(Z p (2)+j + l) (1 " CSt ' a) 

K^y-^)) (i - Cst - a) - (25) 

On the other hand, assume Z n {2) ^ Cst, so that ^(2)^(3) ^ (1 - e 2 ) 2 Z J (2)(Z i (2) + 1); 
then 



2\-2ST^ ^{X,-i=0,X, = l} , 2w4 2 



=p i=p 

k—1 

^■f Af_i =Q,X;=1> 

e ae 

Z,_,C>) 

(26) 
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Now, if Z n {l) ^ Cst(e), using 

sup \Vj,k\lj*+ a k\F n ) > 1 



Cst 



k^j^n 



1 1 

+ 



e 4 a-(2) \Z n (2) Z n (3) 



1 

>2' 



where we use a;(2)Z„(3) = a+(2)Z„(l) > (1 - 6 2 )Z„(1). 

Now assume that E holds. If Z n (l) ^ Cst(e), then Lemma 14.41 implies, together 
with (|25|) and (j26lh 



log §@ - log + Cste 2 « ^ 



Z fc (2) 



Z p (2) 



1 



Z p (3) Z fc (3); " Z p (3) 



-Rp Rk + Z k (l) 



Z k (3) 



where we use in the second inequality that R k ^ R p — Zk(l), by ([2 
Therefore 



^(4) >b „^(3) 



z fc m 



Z fc (2) 



Z fe (2) Z fc (3) 



Cste 2 a > 



Z p (2) 



CO 



Cste^o > — 



Therefore liminf a^(3) > on E, which completes the proof of the first part of the 
inclusion. 

Now assume f2(0) D {limsup(o;^(3)/Q! A r(2)) ^} holds. Then Z n (3) / Z n (2) converges 
to 1, and the estimates ( 1241) . ( 1251) and ( 1261) ensure that ^2/iLil{.x' i _i=2,.x j =3} < oo. 
On the other hand Lemma [4.41 ensures, together with Lemma [4.81 and Doob's martin- 
gale Theorem that limsup fc n^^k^n I S ^i- il-PQ_i =2,^=3} | < oo, which completes the 
second part of the inclusion. 

4.4.3 Proof of Lemma 14.61 

Let a := (1 + e)ajT (2), and let fc ^ j ^ n be such that ^ T, t' fc ^ T". 

Lemma [4.41 still holds for Ai', with the modification that Zi(l) has to be replaced 
by Zi(l) — ay/ Z tn (l) in yf letting rj' , <B-' a and r' be the corresponding notation, 



+ 2. « (2)^,(3)+ Z^-^ + V. 



Vtj,t k + r t ^ t , k - r tjt t k . 



i=j+i 



Let us first estimate y', — y ti , for all i G [n,k]: the coupling of Lemma fl~2l holds, as 

i 

long as n e (i) ^ T, n' e (i) ^ T'. Therefore Z',(3) ^ Z t .(3) (and thus 2', ^ 2^), thus 

i ' k 

Z/~(3) ^ Z t + (3) (since the numbers of visits of edge (2,3) are equal for both walks at 
those times), which implies subsequently Z, ; + (4) ^ Z/(4). Similarly Zj~(l) ^ Zp(l) 
so that, using identity fT9l R' t , ^ R ti . 

On the other hand, using that \x\ 2| ln(l + x)| for \x\ < 1, 



^(2)^(3) 



^.(2)^,(3) 



^ 2 



In 



^(2)^(3) 



^.(2)^,(3) 



,2|ln^ + ln^ 

Z u (3) Z> t ,{2) 



2(4 
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Hence 



Vt' -Vu > ~\Rt.. 



Z U (2)Z U (3) Z'{2)Z'M) 



Z-2\y ti \(z' t ,-z ti ] 



Now let 



u{k) := argmax ie[n)fc] (^, - z ti ), r k 
Using (|2"oT) in the proof of Lemma H75| and Y^i=j+i \Vu\ ^ e > we obtain that 

4 - % ^ ^ - ^ " 2er fc + a v /^„(l)(^.(2)- 1 - Z tk {2)- 1 ){\ - Csto) 

Given 6 > 0, let 



(27) 



A := <j sup hjM^k < b y ^ n ^ 

k^j^n ^tA 1 ) 



I k^j^n 3 



Then, by ( I2ip and Chebyshev's inequality, if 6 ^ Cst, then 

P ( A I Ft*) > 1/2. 

Now assume A holds, and apply (1271) for j := n and k such that Z tk (2) ^ 2Z tn (2): if 
Z tn (l) ^ Cst(6), then 



r k > ( - - 36) _ 2eTfc . 

\2 / Z tn (2) 



(28) 



Apply again (127]) for j := it(A;) and and use (1281 : 



4 -z u ^ (l-2 e )r fe -36^3ll ^ 
t k fc Z t „(2) 



I^)(^- 36)-36, 

1 + 2J 12 / I Z tn (2) " 3 Z tn (2) 



^(1) > o L} fzJX) 



if a ^ Cst(6) and e ^ Cst. 

/ 

We conclude by the remark that z tn (resp. z' t , ) converge to on £7(0) (resp. Q (0)), 
so that P(Q n n n A) = 0, and P((Q„ n Q'J C 1 J^J ^ P(A | JF U ) > 1/2 if 6 > Cst. 



5 Appendix 

We recall Levy's conditional Borel-Cantelli Lemma. Let F = (J r rt ) ne N be a filtration, 
and let (£ n )neN be an F-adapted sequence taking values in M + . 

Lemma 5.1 Assume (£ n )«eN ^ s o.s. bounded by a constant C > 0. Then 

< 00 I = <^ ^E(&|.F fc _i) < 00 I . 



. fe=i 



. fe=i 
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PROOF: Let 

n 

M„:=$^(&-E(&|.F fc _i)), 

k=l 

with jFq := 0. Then (M n ) ngN is a martingale, and 

n— 1 n— 1 / n— 1 \ 

< M > n := ^E((M fc - M^i) 2 !^-!) < ^E^l^-i) = O I^H^k-i) ■ 
fc=i fc=i \fc=i / 

Now, almost surely, either < M >oo< oo or M n / < M >„ — >■ 0, by Levy's strong 
law of large numbers (see for instance [15], Chapter 12, § 14), with yields the result. □ 
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